Gesterial Control

Created Fall 2024 · Unity · C# · MediaPipe

Source code on GitHub  ·  Technical guide (PDF)


Key Words: Gesture-controlled interaction tool · MediaPipe hand tracking · Real-time particle system · Technical guide · Linear interpolation · Trigonometric calculations · Collision detection


Gesterial Control: particles following tracked fingers

What I Built


Overview

A gesture-controlled interaction tool built in Unity. Using a webcam and MediaPipe hand tracking, players steer a real-time particle system with their thumb and index finger, no controller needed. I also wrote a technical guide so others can set it up and use it.